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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )□ Responsive to communication(s) filed on . 

2a)n This action is FINAL. 2b)S This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-12 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) \3 Claim(s) is/are allowed. 

6) K Claim(s) 1-12 is/are rejected. 

Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10)^ The drawing(s) filed on 15 December 2000 is/are: a)\Zl accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet{s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d). 

1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. §§119 and 120 

12)13 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
b)n Some * c)C\ None of: 

Certified copies of the priority documents have been received. 
Certified copies of the priority documents have been received in Application No. . 



bM All 
1.1EI 

2. n 

3. n 



Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

13) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application) 

since a specific reference was included in the first sentence of the specification or in an Application Data Sheet. 
37 CFR 1.78. 

a) □ The translation of the foreign language provisional application has been received. 

14) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 since a specific 

reference was included in the first sentence of the specification or in an Application Data Sheet. 37 CFR 1 .78. 
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DETAILED ACTION 
Drawings 

1 . Figures 1-12 should be designated by a legend such as -Prior Art- because only that 
which is old is illustrated. See MPEP § 608.02(g). A proposed drawing correction or corrected 
drawings are required in reply to the Office action to avoid abandonment of the application. The 
objection to the drawings will not be held in abeyance. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

3. Claims 1-5 and 7-12 are rejected under 35 U.S.C. 102(e) as being anticipated by Sun et al 
(U.S. Patent No. 5,969,764). 

Referring to claim 1, which is representative of claims 1 1 and 12, 

i. Input means for inputting image data of plural objects is illustrated by Sun et al in 
figure 5 by the digital image source (10). 

ii. Encoding means for encoding the image data inputted by the input means on an 
object basis is explained by Sun et al in column 4, lines 43-5 1. Sun et al explain that the 
video signal encoder (12 of figure 5) is provided image information on a Video Object 
basis, corresponding to the general encoding method of MPEG-4. 
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iii. Control means for setting a priority order of code amount allocation for each of 
the objects and in accordance with the priority order, controlling encoding conditions for 
each of the objects is explained by Sun et al in column 6, line 56 to column 7, line 4 and 
column 9, lines 40-64. Sun et al explain that bits available in a buffer (column 6, lines 
28-35) are redistributed according to a priority allocation amount of the objects, which is 
determined based on the size of the object and the amount of activity that the object is 
experiencing. The equation to determine the allocation amount is based on weighted 
motion, size, and mean absolution difference parameters. Therefore, objects with a 
greater size, motion, or mean absolute difference would be given a higher priority and 
thereby allocated a larger number of bits for encoding. 

iv. The control means controlling the encoding conditions in the encoding means so 
that a total code amount obtained by encoding the image data of the plural objects does 
not exceed a predetermined code amount is explained by Sun et al in column 6, lines 28- 
35 wherein the predetermined code amount is given by the target rate, which cannot be 
exceeded. 

Referring to claim 2, the control means changing the priority order at a predetermined 
timing is explained by Sun et al in column 9, lines 40-42. Sun et al explain that the objects are 
encoded at the same frame rate and therefore the priority order of each object would be 
determined for every frame, corresponding to a predetermined timing. 

Referring to claim 3, the predetermined tuning being determined according to how many 
times a code amount reduction processing for the objects is executed or according to code 
amounts of the objects is explained by Sun et al in column 9, lines 40-42. Sun et al explain that 
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the priority bit allocation amount of each video object is determined in each frame. Therefore, 
when each video object has been processed once, then the system of Sun et al will process the 
next object. Therefore, the system of Sim et al changes the priority bit allocation amount of each 
object according to how many times the processing has been performed for each object. 

Referring to claim 4, when the code amount of an object set to a lowest priority becomes 
smaller than a predetermined lower limit value, the control means setting another object to the 
lowest priority is explained by Sun et al in column 6, line 64 to column 7, line 4. Sun et al 
explain if lower bound constraints on the bits used to encode an object are exceeded, then the 
system will invoke the pre-frame skip control. By skipping frames, the bit allocation to an object 
can be increased so that the lower bound constraints are not met. 

Referring to claim 5, the encoding means breaking down the image data of the objects 
into pixel data and shape data and encoding the pixel data and shape data and the control means 
determining the priority order in accordance with a size of shape data of the objects is explained 
by Sun et al in the abstract and in column 9, lines 40-64. Sun et al explain in the abstract that the 
texture (corresponding to the pixel data), motion, and shape data of each object is encoded. The 
priority order of the bit allocation of the objects is explained to be a ftmction of the motion, size, 
and mean absolute difference of each object. Therefore, objects with a greater size, motion, or 
mean absolute difference would be given a higher priority and thereby allocated a larger number 
of bits for encoding. 

Referring to claim 7, the encoding means including quantization means for quantizing the 
image data of the objects and quantization parameters of the quantization means being controlled 
by the encoding conditions is explained by Sun et al in colunm 9, lines 21-27 and illustrated in 
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figure 3. The quantization means (25) determines the quantization parameters according to the 
target distribution (32). 

Referring to claim 8, a recording means for recording the data encoded by the encoding 
means into a recording medium is illustrated by Sun et al in figure 5 by the buffer (17). 

Referring to claim 9, the input means comprising image pickup means for photographing 
an object image and generating image data is illustrated by Sun et al in figure 5 by the digital 
image source (10). 

Referring to claim 10, a video camera being provided with the image processing 
apparatus is data is illustrated by Sun et al in figure 5 by the digital image source (10) connected 
to the image processing apparatus (12). Sun et al explain in the abstract that the image 
processing is performed on video data, which is captured by a video camera. 



4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 



5. Claim 6 is rejected imder 35 U.S.C. 103(a) as being impatentable over Sim et al in view 
of Suzuki et al (U.S. Patent No. 6,415,057). 

Referring to claim 6, the encoding means executing the encoding operation in accordance 
with MPEG-4 and the control means determining the priority order in accordance with the sizes 
of the boimding boxes of the objects is explained by Sun et al in column 4, lines 59-65. Sun et al 
explain that the encoding is performed as described according to the MPEG-4 standard. 



Claim Rejections - 35 USC § 103 



Application/Control Number: 09/736,438 Page 6 

Art Unit: 2621 

However, Sun et al do not explicitly explain using bounding boxes to describe the size of the 
objects. Suzuki et al illustrate using bounding boxes to explain the dimensions of an object in 
figures 1 1 A and 1 IB. By using bounding boxes to describe the dimensions of an object, the area 
of the box can be determined by a simple multiplication of the two dimensions in order to 
determine the bit allocation amount for the object in the system of Sun et al. Therefore, it would 
have been obvious to one of ordinary skill in the art at the time the invention was made to use a 
bounding box to explain the size of an object so that the object size is described more efficiently 
as it is a function of only two variables. 

Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Scorse et al (U.S. Patent No. 5,128,776) - To exhibit selectively transmitting 
portions of a video frame at selected resolution in order to maintain a desired bit 
rate as explained in the abstract. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Hussein Akhavannik whose telephone number is (703)306-4049. 
The examiner can normally be reached on M-F 8:30-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Leo H. Boudreau can be reached on (703)305-4706. The fax phone number for the 
organization where this application or proceeding is assigned is (703)872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703)305-3900. 
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Hussein Akhavannik 
December 16, 2003 
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